Let's Chalk About It: Introducing the TinyTalks Curriculum, a Paradigm for Short, Virtual Chalk Talks.

ABSTRACT: In busy clinical environments, educational opportunities must be designed to accommodate learner-specific needs. Many adult learners prefer short, relevant, technology-enhanced learning. As such, electronic learning (e-learning) experiences have become a prominent part of medical education. Yet, there remain challenges to e-learning experiences in the current educational landscape. To address these challenges, the authors developed the TinyTalks paradigm, which serves as the educational foundation for the TinyTalks curriculum.The TinyTalks paradigm was developed using the existing e-learning literature and foundational principles of adult learning and related theories. The TinyTalks paradigm includes 3 ground rules: (1) all TinyTalks videos must identify a category (approach to, explanation of, or application of) to clarify the focus of the topic, (2) all TinyTalks videos must be less than 7 minutes with all material presented on one virtual chalkboard screen, and (3) all TinyTalks videos must use the hook, frame, and delivery model, which guides the creation of the video. The resulting TinyTalks curriculum is an online repository of short, chalk talk-style educational videos, developed by interdisciplinary health professionals and targeted to the level of trainees, that is available to be used flexibly by learners for just-in-time learning, flipped classroom sessions, and/or self-study.The authors used Kern's 6-step approach to curriculum development as the conceptual framework for the development and implementation of the TinyTalks curriculum at Mass General for Children (June 2021-January 2023). While developing and implementing the curriculum, the authors focused on topic selection, stakeholder recruitment, establishing a process flow, and creating a virtual home.The authors believe the TinyTalks paradigm outlines an effective educational strategy that accommodates the unique needs of both learners and teachers in the medical education setting. The next steps are to scale the TinyTalks curriculum up by expanding the content library and to evaluate its efficacy.

Development and validity evidence for the resident-led large group teaching assessment instrument in the United States: a methodological study.

PURPOSE: Despite educational mandates to assess resident teaching competence, limited instruments with validity evidence exist for this purpose. Existing instruments do not allow faculty to assess resident-led teaching in a large group format or whether teaching was interactive. This study gathers validity evidence on the use of the Resident-led Large Group Teaching Assessment Instrument (Relate), an instrument used by faculty to assess resident teaching competency. Relate comprises 23 behaviors divided into six elements: learning environment, goals and objectives, content of talk, promotion of understanding and retention, session management, and closure. METHODS: Messick's unified validity framework was used for this study. Investigators used video recordings of resident-led teaching from three pediatric residency programs to develop Relate and a rater guidebook. Faculty were trained on instrument use through frame-of-reference training. Resident teaching at all sites was video-recorded during 2018-2019. Two trained faculty raters assessed each video. Descriptive statistics on performance were obtained. Validity evidence sources include: rater training effect (response process), reliability and variability (internal structure), and impact on Milestones assessment (relations to other variables). RESULTS: Forty-eight videos, from 16 residents, were analyzed. Rater training improved inter-rater reliability from 0.04 to 0.64. The Φ-coefficient reliability was 0.50. There was a significant correlation between overall Relate performance and the pediatric teaching Milestone, r = 0.34, P = .019. CONCLUSION: Relate provides validity evidence with sufficient reliability to measure resident-led large-group teaching competence.

Giving Literal Thanks: An ACGME-Sponsored Initiative to Bring Residents Back to the Bedside.

Background Resident burnout is at an all-time high. In response, the Accreditation Council for Graduate Medical Education (ACGME) developed the Back to Bedside grant for resident-led burnout interventions that increase the time residents spend with patients. Objective We designed a resident-patient reading intervention, Giving Literal Thanks (GLT), intended to increase meaningful time residents spend with patients and thereby decrease burnout. Methods All 65 pediatric residents rotating through our academic hospital's inpatient units from Fall 2019 through Fall 2021 were invited to read and gift books to their patients. We studied our intervention's relationship to resident burnout using a convergent mixed-methods design, including anonymous, unlinked pre-, peri-, and post-intervention surveys and focus groups. Qualitative and quantitative data were analyzed separately, then integrated to describe burnout pre- and post-intervention. Results Forty-one of 65 residents (63.1%) completed pre-intervention surveys, and 8 of 65 (12.3%) completed post-intervention surveys. Twenty-seven resident-patient reading interactions were recorded, and 2 focus groups were held (1 pre- and 1 post-intervention). Five themes were identified: (1) limited opportunities exist to spend time at the bedside; (2) spending time at the bedside is valuable; (3) other responsibilities may preclude time at the bedside; (4) GLT could promote positive outcomes; and (5) GLT might not be the right tool to reduce burnout. Further quantitative data analysis was prevented by low survey response rates. While GLT was positively received and feasible, we were unable to show an improvement in burnout. Conclusions GLT was well-regarded but may not improve resident burnout.

Needs Assessment of Residents and Nurses for Interprofessional Cross-Cultural Curriculum.

BACKGROUND: Clinicians must learn to care for patients from different cultures. They must also work in teams for optimal outcomes. Few studies have analysed the intersection of cross-cultural care and interprofessional education. We completed a needs assessment to determine what paediatric residents and nurses view as essential cross-cultural components. METHODS: We led a sequential mixed-methods study of residents and nurses at an urban tertiary care centre. We administered the 'Residency Training in Cross Cultural Care' instrument. Survey results informed focus group interview guide development. Thematic analysis of qualitative data was conducted following the five stages to qualitative research framework. FINDINGS: Thirty-five residents (70%) and 46 nurses (66%) completed the survey. Five residents and six nurses attended a focus group. Five themes resulted: 1) lack of clinician diversity and cross-cultural training, 2) effective cross-cultural care not always delivered, 3) multiple challenges for delivery of effective cross-cultural care, 4) call to action for enhanced cross-cultural education and 5) different cross-cultural educational needs between nurses and residents. DISCUSSION: Residents and nurses conveyed that meaningful cross-cultural care education is imperative, lacking, and must offer skills to improve patient care. They call for a robust cross-cultural curriculum that is up to date and teaches about intersectionality. CONCLUSION: We have used this data to implement interprofessional interventions to meet their unique learning needs and enhance upstander skills by using facilitated discussions of techniques, case studies and role plays. Ultimately, teaching all clinicians to care for patients of other cultures may lead to more equitable care.

A Nurse/Intern Partnership Program Accelerates Positive Relationship Formation Between Pediatric Interns and Pediatric Nurses.

BACKGROUND: The relationship between nurses and interns affects the quality of patient care; efforts to improve this relationship are necessary for optimal care. Previously, relationship formation was found to depend on mutual trust, respect, effective communication, and undergoing the process of role formation, all of which require time. This led to the hypothesis that instituting a Nurse/Intern Partnership Program (NIPP) would accelerate relationship formation. METHODS: Using a semi-structured interview guide, prior to NIPP implementation, one nurse (n = 5) and 2 second-year resident (total n = 6) focus groups were held. After implementation, one nurse (n = 6) and one intern (n = 9) focus group were held. The focus group data were analyzed using the 5 stages of qualitative research framework. RESULTS: Thematic data analysis with 3 independent coders supported the previously developed model of relationship formation; the NIPP accelerated relationship formation between nurses and interns through creating an early ally, improving communication, and increasing role understanding. The program may have improved the culture of the pediatric unit. The interns reported more of a positive impact of the NIPP on nurse/intern relationship than the nurses. CONCLUSIONS: The NIPP was positively received by pediatric residents and nurses and successfully accelerated relationship formation between the 2 groups.

Confidence of Faculty in Writing Letters of Recommendation for Pediatric Fellowship Applicants.

BACKGROUND: The assessment of pediatric residents applying to subspecialty fellowship programs relies on faculty letters of recommendation (LOR). However, it is unclear if pediatric faculty are confident that their LOR are effective. OBJECTIVE: This study aims to assess the confidence of pediatric faculty in writing an effective LOR for pediatric residents applying to subspecialty fellowship programs. METHODS: Survey development was conducted using evidence-based best practices. Surveys were distributed via email in 2021 to all full-time pediatric faculty members who taught pediatric residents in a large academic medical center. Categorical values were compared by chi-square test. RESULTS: Eighty-five out of 150 (57%) faculty members completed the survey. Forty-one percent of participants were very confident that their LOR provided adequate content to assess residents during the application process. Confidence was associated with higher academic rank (p=0.02), frequent contact with residents (p=0.01), and writing >2 LOR in the last five years (p=0.0002). Confident LOR writers were more likely to describe their own background, details about the resident's scholarly activity, and the resident's ability to work as part of a team. Thirty-five percent of respondents reported never considering gender bias when writing LOR, whereas 28% reported always considering gender bias. Eighty-seven percent of respondents reported an interest in receiving LOR writing guidelines. CONCLUSION: Half of the faculty respondents were not very confident in their ability to write an effective LOR for pediatric residents applying for a fellowship. Faculty development and standardized instructions on writing effective LOR may be helpful both at the institutional and national levels, including the importance of considering gender bias when writing LOR.

Psychological safety between pediatric residents and nurses and the impact of an interdisciplinary simulation curriculum.

BACKGROUND: Effective teamwork in interdisciplinary healthcare teams is necessary for patient safety. Psychological safety is a key component of effective teamwork. The baseline psychological safety on pediatric inpatient healthcare teams is unknown. The purpose of this study is to determine the baseline psychological safety between pediatric nurses and residents and examine the impact of an interdisciplinary nighttime simulation curriculum. METHODS: A convergent, multistage mixed methods approach was used. An interprofessional simulation curriculum was implemented fall 2020 to spring 2021. Qualitative focus group data and quantitative survey data on team psychological safety were collected and compared, both pre- and post-intervention and across nurses and residents. Thematic analysis of the qualitative data was conducted, and themes integrated with survey findings. RESULTS: Data were collected from 30 nurses and 37 residents pre-intervention and 32 and 38 post-intervention, respectively. Residents and nurses negatively rated psychological safety (pre-intervention mean = 3.40 [SD = 0.72]; post-intervention mean = 3.35 [SD = 0.81]). At both times psychological safety was rated significantly lower for residents (pre-intervention mean = 3.11 [SD = 0.76], post-intervention mean = 2.98 [SD = 0.84]) than nurses (pre-intervention mean = 3.76 [SD = 0.45], post-intervention mean = 3.79 [SD = 0.50]), all P < .001. Qualitative analysis identified six integrated themes: (1) influence of existing relationships on future interactions, (2) unsatisfactory manner and frequency of communication, (3) unsatisfactory resolution of disagreements (4) overwhelming resident workload impairs collaboration, (5) interpersonal disrespect disrupts teamwork, and (6) interprofessional simulation was useful but not sufficient for culture improvement. CONCLUSION: Resident-nurse team psychological safety ratings were not positive. While interprofessional simulation curriculum shows promise, additional efforts are needed to improve psychological safety among residents and nurses.

The Acceptability of Avatar Patients for Teaching and Assessing Pediatric Residents in Communicating Medical Ambiguity.

Background: Simulation offers a means to assess resident competence in communication, but pediatric standardized patient simulation has limitations. A novel educational technology, avatar patients (APs), holds promise, but its acceptability to residents, educational relevance, and perception of realism have not been determined. Objective: To determine if APs are acceptable, provide a relevant educational experience, and are realistic for teaching and assessment of a complex communication topic. Methods: Pediatric residents at one academic institution participated in an AP experience from 2019 to 2021 consisting of 2 scenarios representing issues of medical ambiguity. After the experience, residents completed a survey on the emotional relevance, realism, and acceptability of the technology for assessment of their communication competence. Results: AP actor training required approximately 3 hours. Software and training was provided free of charge. Actors were paid $30/hour; the total estimated curricular cost is $50,000. Sixty-five of 89 (73%) pediatric residents participated in the AP experience; 61 (93.8%) completed the survey. Forty-eight (78.7%) were emotionally invested in the scenarios. The most cited emotions evoked were anxiety, uncertainty, concern, and empathy. The conversations were rated by 49 (80.3%) as realistic. APs were rated as beneficial for learning to communicate about medical ambiguity by 40 (65.5%), and 41 (66.7%) felt comfortable having APs used to assess their competence in this area. Conclusions: Pediatric residents were emotionally invested in the AP experience and found it to be realistic. The experience was rated as beneficial for learning and acceptable to be used for assessment of how to communicate medical ambiguity.

Going Virtual: Objective Structured Teaching Exercises as an Innovative Method for Formative Resident Education.

BACKGROUND: The coronavirus disease 2019 pandemic forced residency programs to adapt teaching to the virtual arena. Objective Structured Teaching Exercises (OSTEs) are a simulation-based session we previously implemented in our in-person pediatric curriculum. We aimed to assess feasibility of and resident satisfaction with the transition to virtual learning for simulation-based OSTEs. METHODS: The pediatrics residency program at our hospital has a weekly academic half-day for residents where the OSTEs were held annually in person 2018 to 2019 and virtually in 2020. Surveys were collected from participating residents and faculty to compare teaching experience, feedback quality, and satisfaction with the session. RESULTS: Over 3 academic years, there were 159 total teaching sessions, 3 of which were OSTEs. The OSTE session was highly rated each year and was the second highest rated virtual session. Residents felt the OSTEs improved their teaching regardless of the virtual versus in-person platform (P = .77), and the quality of feedback as rated by the resident teacher was higher for virtual sessions (P < .001). CONCLUSIONS: Transitioning the OSTE to a virtual platform was both feasible and effective when compared to the in-person OSTE. In the transition to virtual learning, educators should consider opportunities for simulation-based teaching such as OSTEs.

Taking the Pulse on Pediatric Simulation: A National Survey of Pediatric Residency Programs' Simulation Practices and Challenges.

OBJECTIVES: There is abundant literature on simulation use in individual pediatric residency programs but limited overall data on simulation in US pediatric residency programs. This study sought to determine how US pediatric residency programs use simulation for teaching and assessment and the challenges programs face in their use of simulation. METHODS: The Association of Pediatric Program Director's Healthcare Simulation in Pediatrics Learning Community members developed a 15-multipart question survey on the use of simulation in US pediatric residency programs using best practices in survey design. The survey was distributed electronically to US pediatric residency program directors. Qualitative questions were analyzed by content analysis and quantitative questions using descriptive statistics. RESULTS: The survey response rate was 21%; respondents were disproportionately from large academic medical centers. Qualitative analysis found that respondents use simulation to teach pediatric residents in the areas of urgent/emergent situations, procedures, and communication, and common challenges to simulation implementation are time, physical resources, expertise, competing priorities, logistics, and buy-in. Quantitative analysis demonstrated that, although respondents are largely confident that their simulation programs improve resident preparedness and competence, few objectively evaluate their simulation programs. CONCLUSIONS: Pediatric residency programs use simulation for similar purposes and face similar challenges. By collaborating, the resources of the national pediatric simulation community can be leveraged to collect evidence for best practices for simulation use in pediatric residency training.

A randomized controlled trial of an online health tool about Down syndrome.

PURPOSE: We sought to determine if a novel online health tool, called Down Syndrome Clinic to You (DSC2U), could improve adherence to national Down syndrome (DS) guidelines. We also sought to determine if primary care providers (PCPs) and caregivers are satisfied with this personalized online health tool. METHODS: In a national, randomized controlled trial of 230 caregivers who had children or dependents with DS without access to a DS specialist, 117 were randomized to receive DSC2U and 113 to receive usual care. The primary outcome was adherence to five health evaluations indicated by national guidelines for DS. DSC2U is completed electronically, in all mobile settings, by caregivers at home. The outputs-personalized checklists-are used during annual wellness visits with the patient's PCP. RESULTS: A total of 213 participants completed a 7-month follow-up evaluation. In the intention-to-treat analysis, the intervention group had a 1.6-fold increase in the number of indicated evaluations that were recommended by the primary care provider or completed compared with controls. Both caregivers and PCPs reported high levels of satisfaction with DSC2U. CONCLUSIONS: DSC2U improved adherence to the national DS health-care guidelines with a novel modality that was highly valued by both caregivers and PCPs.

Simulated Umbilical Venous Catheter Placement Improves Resident Competence and Confidence.

Background Pediatric ACGME (Accreditation Council for Graduate Medical Education) requirements include demonstrated competence in umbilical line placement. Given a waning number of these procedures clinically available to residents, new methods of procedural teaching must be employed. We developed a simulation-based strategy, using adult-learning principles, to teach umbilical venous catheter (UVC) placement to pediatric residents. We also determined whether procedural teaching via simulation increased confidence and competence among pediatric residents in performing the procedure. Methods Out of 23 first-year pediatric residents, eight participated in the study. Participants completed a survey evaluating their self-perceived competence and confidence in umbilical line placement. Their simulated umbilical line placement was assessed using a standardized checklist. Residents were then trained on simulated line placement in small groups by neonatologists. Six months later, residents completed a post-training survey and were assessed while placing simulated lines. Statistical analysis was completed using a paired t-test for parametric data, Wilcoxon signed-rank sum test for non-parametric data, and McNemar's chi-squared test for categorical data. Spearman's correlation was used for ordinal variables and Pearson's correlation was used for continuous variables. Results Nine PGY-1 (post-graduate year-1) residents completed the pre-training survey and simulation, while eight residents completed the post-training survey and simulation. There was an increase in resident confidence in placing umbilical lines six months after completion of the training session (p = 0.015) even though there was no difference in the number of umbilical lines that residents had placed in the intervening time. The residents performed a greater number of steps correctly after the training compared to their performance before the training (p=0.001). There was a statistically significant positive correlation between resident confidence and the number of steps performed correctly (rs(14)= 0.649, p = 0.006). There was no correlation between confidence and the number of umbilical lines placed on live subjects. Conclusion A teaching strategy that allows pediatric residents to struggle to perform UVC placement in a simulated setting, before receiving expert instruction, is effective at increasing their confidence and competence, even in the absence of exposure to human subjects.

A Resident-as-Teacher Curriculum for Senior Residents Leading Morning Report: A Learner-Centered Approach Through Targeted Faculty Mentoring.

Introduction: Senior resident-led morning report (MR) occurs in many residency programs, but residents rarely receive training on how to facilitate MR or feedback on their facilitation. I created and implemented a required 2-week resident-as-teacher curriculum pairing senior residents with faculty mentors. Methods: The curriculum allowed individualization to each specific resident's needs. The faculty mentor helped the resident set curricular goals, observed and provided feedback on resident facilitation of four MRs and one noontime conference, and reviewed adult learning principles with the resident. The curriculum guided the faculty and resident pair through leading MR and applied evidence to guide resident teaching. I surveyed resident teachers, the residents who attend MR, and faculty mentors to determine the curriculum's perceived educational impact. Results: Over the 2010-2016 academic years, 124 senior residents participated. Senior residents self-reported significantly more confidence, interest, and preparedness for teaching after the curriculum. Trainees attending MR rated the quality of equal value after curriculum implementation, and responded that senior residents leading MR were more likely to give clear explanations, teach at an appropriate level, and were less likely to run out of time. Faculty mentors enjoyed participating and found the one-on-one mentorship relationship important for their satisfaction with the experience. Discussion: Outcome data suggested that the mentorship relationship was the most important element of the curriculum and that flexibility was key to allowing individual needs to be met. The intervention is applicable to other residency programs and specialties, and faculty mentors are not required to have a medical education background.

Look Who's Talking: A Survey of Pediatric Program Directors on Communication Skills Education in Pediatric Residency Programs.

OBJECTIVE: To determine current practices for communication skills curriculum and assessment in pediatric residency programs and to identify programs' greatest needs regarding communication curricula and assessment. METHODS: We surveyed pediatric residency program directors about their programs' approach to teaching and assessing residents' communication skills and how satisfied they were with their curricula and assessment of competence. Respondents were asked about their programs' greatest needs for teaching and assessing communication skills. RESULTS: Response rate was 41% (82/202). Most programs did teach communication skills to residents; only 14% provided no formal training. Programs identified various 1) educational formats for teaching communication skills, 2) curricular content, and 3) assessment methods for determining competence. Many programs were less than satisfied with their curriculum and the accuracy of their assessments. The greatest programmatic need regarding curricula was time, while the greatest need for assessment was a tool. CONCLUSIONS: While teaching and assessment of communication skills is common in pediatric residency programs, it is inconsistent and variable, and many programs are not satisfied with their current communication training. There is need for development of and access to appropriate and useful curricula as well as a practical tool for assessment which has been evaluated for validity evidence.

The Development of an Instrument for Faculty to Assess Resident-Led Large Group Teaching.

OBJECTIVE: The Accreditation Council on Graduate Medical Education requires residents to teach and many residency programs assess resident teaching competency. While much formal resident-led teaching is for large groups, no corresponding published assessment instrument with validity evidence exists. We developed an instrument for faculty to assess pediatric resident-led large group teaching and gathered preliminary validity evidence. METHODS: Literature review and our experience leading resident-as-teacher curricula informed initial instrument content. Resident focus groups from 3 northeastern pediatric residency programs provided stakeholder input. A modified Delphi panel of international experts provided iterative feedback. Three investigators piloted the instrument in 2018; each assessed 8 video recordings of resident-led teaching. We calculated Cronbach's alpha for internal consistency and intraclass correlation (ICC) for inter-rater reliability. RESULTS: The instrument has 6 elements: learning climate, goals/objectives, content, promotion of understanding/retention, session management, and closure. Each element contains behavioral subelements. Cronbach's alpha was .844. ICC was excellent for 6 subelements, good for 1, fair for 1, and poor for 3. CONCLUSIONS: We developed an instrument for faculty assessment of resident-led large group teaching. Pilot data showed assessed behaviors had good internal consistency, but inconsistent interrater reliability. With further development, this instrument has potential to assess resident teaching competency.

Medical Education Journal Club for the Millennial Resident: An Interactive, No-Prep Approach.

OBJECTIVE: The traditional journal club (JC) format of reviewing an article followed by group discussion may be misaligned with millennial learners' needs and may not rely on best principles of adult learning. Our objective was to deliver an interactive JC allowing pediatric residents to critically engage with medical education research without previous preparation. METHODS: We conducted 4 one-hour "interactive, no-prep" medical education JCs for pediatric residents in a medium-sized program in 2018. Without previous reading, participants developed methods to answer the study question, compared that with actual methods, analyzed the results, and extrapolated the findings. We developed a simple, anonymous evaluation tool to determine perceived educational impact, analyzed using mixed methods. RESULTS: A total of 52 of 59 participants (88% response rate) indicated on a 7-point scale that the JC helped them think about how to analyze a paper (mean = 5.32), use a paper to inform further study questions (mean = 5.42), and understand medical education research (mean = 6.00). Four qualitative themes indicated that, although improvement was possible, it provided a strong interactive learning experience. CONCLUSIONS: Our JC approach using active learning principles and requiring no advance preparation is proof of concept that faculty's objectives to teach critical literature evaluation and millennial needs for engagement can be simultaneously met.

Simulation for Milestone Assessment: Use of a Longitudinal Curriculum for Pediatric Residents.

INTRODUCTION: Determining clinical competency on the milestones requires direct observation of residents, which is difficult for faculty members who are also providing patient care. Simulation can potentially represent an effective standardized tool for high-stakes assessment. Using a longitudinal simulation curriculum with formative and summative components, we conducted a pilot investigation to examine whether (1) performance on the formative cases predicted performance on the summative cases and (2) performance on the summative cases correlated with the clinical competency committee's (CCC) milestone placement. METHODS: We developed 6 formative and 6 matched summative cases for pediatric interns that covered core pediatric topics. The interns progressed through the formative cases in pairs during the course of the academic year and then through the summative cases back to back individually at the end of the year. The interns were evaluated using a competency-based simulation evaluation. We determined the relationship between the formative and summative scores and between the summative scores and those from the CCC. RESULTS: The relationship between formative and summative scores was not statistically significant. There was a statistically significant relationship between summative and CCC scores. CONCLUSIONS: Significant methodological limitations preclude definite conclusions about the predictive power of simulation cases for Pediatric Milestones-based assessment. However, our work is an example of how simulation is a potentially useful tool for assessing residents' skill development on the Pediatric Milestones. More rigorous research is needed to determine the extent to which simulation can be used for high-stakes, milestones-based assessment.

Gearing up for milestones in surgery: Will simulation play a role?

BACKGROUND: The Consortium of American College of Surgeons-Accredited Education Institutes was created to promote patient safety through the use of simulation, develop new education and technologies, identify best practices, and encourage research and collaboration. METHODS: During the 7th Annual Meeting of the Consortium, leaders from a variety of specialties discussed how simulation is playing a role in the assessment of resident performance within the context of the Milestones of the Accreditation Council for Graduate Medical Education as part of the Next Accreditation System. CONCLUSION: This report presents experiences from several viewpoints and supports the utility of simulation for this purpose.